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I.  Introduction 


We  consider  a  discrete  time  single  server  queueing  system  that  is  fed  by  N  indepen¬ 
dent  input  streams  (Fig.l).  The  service  time,  T,  is  constant  and  equal  to  one,  which  is  the 
distance  between  successive  arrival  points.  The  first  in  -  first  out  policy  is  adopted  and 
the  buffer  size  is  infinite. 

When  successive  arrivals  in  each  input  stream  are  independent,  the  above  queueing 
system  has  been  studied,  [  1  ],  and  the  mean  time,  Dj,  that  a  customer  spends  in  the  system 
was  then  found  to  be  given  by  the  following  expression. 

r  n  n  , 
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n=l  n=l 

where  an  is  the  probability  of  an  arrival  at  the  input  of  the  queue,  and  corresponds  to  the 
mean  arrival  rate  of  the  Bernoulli  process  that  describes  the  arrival  streams. 

If  the  arrival  process  is  a  first  order  ergodic  Markov  chain  with  state  space  S  =  {0. 
1 },  where  1  corresponds  to  an  arrival  and  0  to  the  absence  of  such  an  event,  then  the 
average  time,  DM,  that  a  customer  spends  in  the  system  is  given  by  the  expression  below, 
12],  [3], 
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where  yn  -  Pfl/I )  -  I’ (I/O)  and  where  f/.n  is  the  arrival  rate  given  by  the  expression 


'w‘5 


P(  / )  denotes  conditional  probability. 


In  this  paper,  it  is  assume  that  each  input  stream  is  described  by  a  finite-state  Mar¬ 
kov  chain.  The  cardinality  of  the  state  space  of  the  Markov  chain  associated  with  the  ith 
stream  is  denoted  by  Mr  The  arrival  process  of  each  input  stream  corresponds  then  to  a 
mapping  from  a  finite-state  Markov  chain  onto  the  set  {0,1},  where  1  represents  a  single 
arrival  and  where  0  represents  no  arrival.  In  this  case,  the  average  time  that  a  customer 
spends  in  the  system  is  obtained  from  the  solution  of  M,xM-,x  ■  •  •  xMN  linear  equations. 


Clearly,  the  Markov  arrival  system  described  in  [2]  is  a  special  case  of  the  general 
system  considered  in  this  paper.  In  [2],  the  underlying  Markov  chain  has  two  states  only, 
and  actually  coincides  with  the  arrival  process.  The  closed  form  solution  obtained  in  [2], 
for  the  average  time  that  a  customer  spends  in  the  system,  does  not  extend  to  the  case 
where  multi-state  Markov  chains  are  present.  The  two  state  Markov  model  gives  rise  to  a 
second  order  equation,  whose  roots  are  used  in  the  derivation  of  the  closed  form  solution. 
This  procedure  does  not  extend  to  a  larger  state  space  Markov  model,  since  then  expres¬ 
sions  for  the  roots  of  high  order  equations  would  be  needed. 


IMi  r 
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The  queueing  system  with  Bernoulli  arrivals,  is  also  a  special  case  of  the  system 
considered  in  this  paper.  In  that  case,  the  arrival  process  coincides  with  the  underlying 
Markov  process  and  the  state  transition  probabilities  are  properly  selected.  Then,  D,  can 
be  derived  from  the  solution  of  4  linear  equations. 


The  system  considered  here  has  several  applications.  For  example,  the  single  server 
may  correspond  to  some  central  node  which  accepts  and  processes  packets  originating 
from  several  random-access  communication  systems.  Each  input  stream  represents  then 


the  output  process  from  a  random-access  communication  system;  that  is,  the  process  of 
the  successfully  transmitted  within  the  latter  system  packets.  Then,  the  per  stream  Ber¬ 
noulli  model  is  unrealistic,  and  the  two-state  Markov  model  can  be  inefficient,  (4|.  On 


the  other  hand,  a  three-state  Markov  model  per  input  stream  may  represent  an  efficient 
approximation  and  may  be  intuitively  pleasing.  For  example,  in  synchronous  packet 
random-access  systems,  the  three  states  may  correspond  to  the  idle  versus  success  versus 
collision  channel  states  per  slot.  Each  input  stream  is  then  governed  by  this  three-state 
process,  whose  characteristics  are  induced  by  the  deployed  random-access  algorithm. 
The  above  three-state  process  is  not  necessarily  Markov,  but  can  be  closely  approximated 
by  a  Markov  such  process,  especially  in  the  presence  of  heavy  traffic,  |4], 

II.  The  general  queueing  system 

The  general  configuration  of  the  problem  that  will  be  described  in  this  section 
appears  in  Fig  1.  The  system  consists  of  N  input  streams  which  feed  a  single  server.  The 
server  has  an  infinite  capacity  buffer. 

The  arrival  processes  {a  2,  •  •  •  ,  N,  are  assumed  to  be  synchronized 

discrete  time  processes,  and  at  most  one  arrival  can  occur  in  each  input  line  per  unit  time. 
The  time  separation  between  successive  possible  arrival  points  is  constant  and  equal  to 
one.  The  arrival  processes  {a1J}J>0,  i  =  1,  2,  •  •  •  ,  N,  may  represent  the  output  processes 
of  multi-user  random  access  slotted  communication  networks,  where  the  arrival  points 
coincide  then  with  the  ends  of  slots.  It  is  obvious  that  in  the  latter  system,  the  condition 
of  having  at  most  one  packet  arrival  per  input  stream  and  per  unit  time  is  satisfied. 


The  first  in  -  first  out  (FIFO)  policy  is  adopted  and  the  service  time  is  assumed  to  be 
constant  and  equal  to  the  distance  separation  of  successive  arrival  points.  More  than  one 
arrivals  (from  different  input  streams)  that  occur  at  the  same  arrival  point  are  served  in  a 
randomly  chosen  order.  In  the  packet  communication  system,  the  service  time  policy 
implies  that  arriving  and  departing  packets  have  the  same  length. 

Let  {xiJ}j>0  denote  a  discrete  time  ergodic  Markov  process  associated  with  the  ilh 

i  1  M 

input  stream,  with  finite  state  space  S  =  {O;  ,  •  •  •  ai  }.  Let  also  a;  be  a  stationary  map¬ 
ping  rule  from  the  set  S;  onto  the  set  {0,  1},  where  1  corresponds  to  an  arrival  and  0  to 
the  absence  of  such  an  event.  Then  the  arrival  process  of  the  ith  input  stream  is 

(ai  }j>0  =  (ai(x,J)}j>0=  {ai(xi°).  a,(xi').  •••  }. 

From  the  description  of  the  arrival  process  it  is  implied  that  successive  arrivals  from  the 
same  input  stream  are  not  independent,  but  they  are  governed  by  an  underlying  finite 
state  Markov  chain,  {xjJ}j>0  ,  and  a  stationary  mapping  rule  a^ 

In  this  system,  it  is  assumed  that  the  processes  {x  i  =  1,  2,  •  •  •  ,  N,  are  mutu¬ 
ally  independent  and  thus  the  arrival  processes  {a-}j>0,  i  =  1,  2,  •  •  ■  ,  N,  are  also 

independent.  If  { b^  }j>0  =  {b°,  b1,  }  is  the  process  that  describes  the  total  arrivals 

occuring  at  a  single  arrival  point,  then 

N 

=  Z  a,(x,j)  ,  j  =  0,  1,  2,  •  •  •  (2) 

i=l 

and  W  £  {0,  1,  2,  •  •  •  ,  N}. 

Referring  to  the  example  of  the  output  process  of  a  multi-user  random  access  com¬ 
munication  network,  we  may  define  {x-}j20  to  be  the  process  that  describes  the  state  of 
the  channel  at  the  end  of  a  slot.  Let  us  consider  a  ternary  channel  state  space 


S‘  =  {0,  1,2} 

where,  0.  1  and  2,  respectively,  denote  that  0,  1,  or  more  than  1  packets  attempted  packet 
transmission  in  a  single  slot.  Since  a  packet  appears  in  the  output  process  only  if  it  is  the 
only  one  transmitted  within  the  corresponding  slot,  the  arrival  process  {a-  }-50  can  be 
clearly  described  via  the  mapping 


ai(XjJ)  = 


*i  =  1 


1  if 
.0  if  x;1  =  0,  2 


The  process  is  controlled  by  the  deployed  random-access  algorithm,  and  is 


generally  non-Markov.  However,  this  process  can  be  approximated  by  a  Markov  process 
{X|  }j>0  wh'ch  has  the  same  state  space  as  {x-}j>0  and  is  ergodic  within  the  stability 
region  of  the  random-access  algorithm.  Simulation  results,  [4],  have  shown  that,  for  at 
least  a  class  of  random-access  algorithms,  the  three-state  Markov  model  provides  a  good 
approximation  of  the  process  {x-j^g. 


III.  Analysis  of  the  queueing  system 

This  section  is  devoted  to  the  analysis  of  the  system  described  in  the  previous  sec¬ 
tion.  The  main  result  of  the  analysis  is  the  derivation  of  the  linear  equations  whose  solu¬ 
tion  give  the  mean  number  of  packets  in  the  system.  This  result,  in  conjunction  with 
Little’s  formula,  provide  the  mean  time  that  a  packet  spends  in  the  system. 

Let  Tt/k)  and  p,(k,  j),  k.j  e  S',  denote  the  steady  state  and  the  transition  probabilities 
of  the  ergodic  Markov  chain,  {xiJ})>0,  i  =  1,2,  •  •  •  ,  N\  Let  also  pn(j  ;  y)  denote  the  joint 
probability  that  there  are  j  packets  in  the  system  at  the  nIh  arrival  point  (arrivals  at  that 


point  are  included)  and  the  states  of  the  Markov  chains  are  y,,  y-,,  •  ■  ■  ,  yN,  where 
y  -  (v,.v-.,  •  •  ■  , v'v ).  The  vector  y  describes  the  state  of  a  new  ergodic  Markov  chain  that 


is  generated  by  the  N  independent  Markov  chains  described  before,  with  steady  state  and 
transition  probabilities  7t(y)  and  p(x,  y)  respectively,  and  with  state  space 


S  =  S!xS“x  •  •  •  xS^. 

The  operation  of  the  system  can  be  descibed  by  an  N  +  1  dimensional  (infinite  state 
space)  Markov  chain  imbedded  at  the  arrival  points,  with  state  space  T  =  (  0,  1,  2, 
•  •  ■  )xS  and  state  probabilities  given  by  the  following  recursive  equations 


N 

pn(j;y)  =  X  pn_1  (j+i  -  Xai(xi)  ;*)  p(*>  y)  .  j^n+i 

x  £  S  i=l 


or  (3) 

j+l 

pn(j;y)=X  X  P  (k;x)p(x,  y)  +  X  pn  '(0;  X)  p  (X,  y)  ,  0<j  <N 

k=l  x  £  Ff.,  _k  xeFj 

where 


N 

Fv  =  {x  =  (Xj,x2,  •  •  •  XN)  E  S  :  £  a^Xj)  =  v}  (4) 

i=l 

There  are  totally  MjxM,x  •  •  •  xMN  equations  given  by  (3)  for  a  fixed  j  and  all  y  E  S, 
where  Mf  is  the  cardinality  of  S1,  i  =  1,  2,  •  •  • ,  N. 

The  original  assumption  concerning  the  ergodicity  of  the  Markov  chains  associated 
with  the  input  streams  implies  the  ergodicity  of  the  arrival  processes  {aiJ}J>0,  i  =  1,2, 
•  •  •  ,  N.  The  latter  together  with  the  well  known  condition,  [5], 

N 

X  x  Jt/Xj  :  a.fXj)  =1)  <  1  {5) 

i=l  x,  £  S‘ 

imply  that  the  Markov  chain  described  in  (3)  is  ergodic  and  there  exist  steady  state 
(equilibrium)  probabilities.  Thus,  we  can  consider  the  limit  of  the  equations  in  (3)  as  n 
approaches  infinity  and  obtain  similar  equations  for  the  steady  state  probabilities. 


By  considering  the  steady  state  probabilities  given  by  (3)  and  manipulating  the 
resulting  equations,  as  it  is  shown  in  Appendix  A,  we  obtain  the  following  system  of 


linear  equations 


P(z;y)=£  X  z  [P(z;x)  +  (z-l)p(0;x)]p(x,y)  ,  yeS 
v=0  x  e  Fv 

where  P(z;y)  is  the  generating  function  of  the  steady  state  distribution  of  the  N+l 
dimensional  imbedded  Markov  chain,  given  in  Appendix  A. 

From  the  independence  of  the  Markov  chains  associated  with  the  input  streams  and 
the  state  description  of  the  imbedded  N+l  dimensional  Markov  chain,  it  is  obvious  that 


7t(x)  =  n  JtjfXj)  ,  p(x,  y)  =  n  Pi(xi>  Yj) 


P(0  ;  x)  =  p0  El  ^i(xj)  (7b) 

i=l 

If  P(z)  is  the  generating  function  of  the  distribution  of  the  number  of  packets  in  the  sys¬ 
tem,  then 


P(z)  =  £  pO)^  =  Z  Z  p(j;y)zj=Z  p(z;y) 

j=0  J=°  yeS  veS 


p(z)=  z  p(z;y) 

y  £  S 

where  P  (z  ;  y),  ye  S,  can  be  derived  by  differentiating  (6)  and  are  given  by 


P(z;y)=Z  I  [fv-Dz  ‘  [P(z  ;  x)  + (z-l)p(O  :  x)l  + 

v=o  x  r  f„ 


+  z  1 P ( z  ;  x)  +  p(0  ;  x ) ]  p(x,y) 


for  y  £  S. 


v- :••••  • '  ' 


Since  P  ( 1 )  is  the  average  number  of  packets  in  the  system,  Q,  from  (8b)  we  have  that 


E" 


i  t# 


(10) 


Q  =  X  P  (i  ;y)  • 

y  e  S 

P ( I  ;  y),  y  eS,  are  in  fact  the  solutions  of  the  following  MjX  •  •  •  xMN  dimensional 
linear  system  of  equations,  which  are  obtained  from  (9)  by  setting  z=l  : 


Pd;y )=Z  I 

v=0  x  e  F„ 


(v— 1)  P  (1  ;  x)  +  P(1  ;  x)  +  p(0  ;  x) 


p(x,y)  ,  yeS 


(ID 


where 


N 

P(1  ;  x)  =  jt(x)  =  n  ^i(Xj) 
i=l 


(12) 


The  MjX  •  •  •  Mn  linear  equations  with  respect  to  y  e  S  that  appear  in  (11)  are 
linearly  dependent.  This  is  usually  the  case  when  the  equations  have  been  derived  from 
the  state  transition  description  of  a  Markov  chain.  By  following  the  procedure  that  is 
shown  in  Appendix  B,  we  obtain  an  additional  linear  equation  with  respect  to 
P  ( 1  ;  y).  y  £  S,  which  is  linearly  independent  from  those  in  (11)  and  is  given  by 


N 

Z  z 

v=0  xeF, 


2(v-l)  P  (1  ;  x)  +  (v-l)(v-2)  P  (1  ;x)  +  2(v-l)p(0;30 


-0 


(13) 


In  appendix  B  we  also  calculate  the  steady  state  probability  that  there  is  no  packet 
in  the  system,  denoted  by  p0.  As  it  was  expected  it  was  found  that 


N 

Po=  1  -  I  I  rc/x,  :  a,(x,)=l) 

i=l  x,  E  S' 

By  substituting  (7b),  (12)  and  (14)  into  (11)  and  ( 13)  and  solving  the  M,x 


(14) 


xM, 


dimensional  linear  svstem  of  equations  that  consists  of  (13)  and  anv  M.x  •  •  ■  xMv  -  1 
equations  taken  from  (1 1),  we  compute  P(1  ;  x)  ,  xcS.  Then,  the  average  number  of 
packets  in  the  system  can  be  computed  by  ( 10). 


The  average  time,  D,  that  a  packet  spends  in  the  system  can  be  obtained  by  usint 
Little’s  formula  and  it  is  given  by 


I  I  ^  (x.  :  ai(Xi)  =  1)  ^ 

i=l  x,  e  S' 

The  denominator  in  the  above  expression  corresponds  to  the  total  input  traffic  to  the 
queueing  system. 


IV.  Conclusions 


The  main  result  of  this  paper  is  a  method  to  calculate  the  mean  time  that  a  customer 
spends  in  the  system,  for  a  queueing  system  with  many  input  streams  and  anivals  that 
depend  on  the  state  of  arbitrary  Markov  chains  associated  with  the  input  streams.  That 
result  can  be  obtained  by  solving  Mtx  •  •  •  xMN  linear  equations,  where  Mj  is  the  cardi¬ 
nality  of  the  Markov  chain  associated  with  the  ilh  input  stream. 

As  a  possible  application,  it  has  been  demonstrated  how  the  queueing  system  under 
consideration  can  approximate  a  queueing  system  fed  by  the  output  processes  of  indepen¬ 
dent  multi-user  random  access  communication  networks. 
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In  this  section  we  derive  the  linear  equations  that  are  given  by  (6).  We  write  the 
steady  staty  probabilities  (under  ergodicity)  by  considering  the  limit  of  (3)  as  n— and 


obtain 


p(j ;  y)  =  X  p  (i+1  -  X  ai<xi)  ;  x)p(x,y)  ,  j>N+i 

xeS  i=l 

j+1 

p(j  ;  y)  =  X  X  P(k  ;  x)  p  (x,  y)  +  £  p  (0  ;  x)  p  (x,  y )  ,  0  <  j  <  N 

k=1  X  e  Fj.,_k  xeF, 

If  P(z  ;  y)  is  the  z-transform  of  the  joint  probability  distribution  that  there  are  j  packets  in 
the  system  and  the  Markov  chain  is  in  state  y,  defined  by 

oo  oo 

p(z ;  y)  =  x  pO  ;  y)^  =  X  pO  ;  y)zj’ 
j=0  j=o 

then,  from  (Aj)  we  obtain 

N  ~  N 

P(z  ;  y)=]T  P(j  ;  y)^  +  x  X  P(j+1  -  X  ai(xi) ;  ^0  p(x  ,  y)  zj 

j=0  j=N+l  x  £  S  i=l 

N  N  oo 

=X  p(i ;  y)^  +X  X  X  pG’+i  -  v ;  x)  p(x ,  J)z} 

j=0  v=0  j=N+l  xeFv 

N  N  oo 

=XP(j;y)zi+X  X  X  p(k  ;  x)  p(x,  y)zk  zv~' 

j=0  v=0  k=N+2-v  x  £  Fv 

n  n  r 

=XPfj:y)zJ  +X  X  zv“'  X  p(k  ;  X)  p(^,  y)zk 

j=0  v=0  x  e  Fv  k=N+2-v 

N  N  r  N+l-v 

=  XP(jA^+X  X  zv_1  p<7-  •  *)  -  X  p(k  ;  x)zk  p(x.y) 

J=0  V-O  \  e  Fv  L  k=0 


=  y  P'j  :  >  ^  +  Z  Z  z  P(z;x)p(x,y) 


J=0 

v-0 

X  cFv 

N 

N 

NVl-v 

-z  Z  zv 

_1  p(0 

;  x)  p(x 

.  y)  - 

-  z 

Z  zv_1  Z  P(k 

V  ^  \  f  F, 

v=0 

X  £  Fv  k=l 

N 

=Z  p<j  •  y)zJ 

N 

+z 

V'  v-l 

Z  z 

P(z  , 

;  x)  p(x  ,  y) 

v-0  x 

£  Fv 

N  Nt.  . . ;  1-k 

-V  X  zV_1  P(0  ;  x)  p(x  ,  y)  -  ^  £  X  zv_1  zkp(k  ;  x)p(x  .y) 

v-0  uF,  k=l  v=0  x£Fv 


S  N 

=  1  P(J  :  y)zJ  +  I  Z  zv-‘P(z;x)p(I,y) 


i=0 

S' 

-z 

z 

v-l 

z 

v=0  x  e  Fv 

N'+l 

p(0  :  X)  p(x,y)  -  £ 

s 

z 

V  zJ  p(  k  :  x )  pi  \ 

v=<) 

\f  F. 

k=  1 

j -k-1 

XC  F 

N 

=z 

J-1 

z 

z 

s 

p(k  ;  x)  z1  p( x  .  y )  +  Z 

V  pi  0  ;  x )  /.'  p(  x  .  s’ ) 

J=0 

k=  1 

VC  F. 

.  B 

J" 

X  £  1 

N 

+z 

z 

V- 

Z 

N 

'  P(z;x)p(x.y)-2 

z 

V  1  „  -  -  - 

z.  p(  0  ;  x  )  p(  x  .  _x  ) 

v=0 

X  £  F 

v-  0 

v  i  F 

N  j-1 

"Z  Z  Z  p(k  ;  x)  zJ  p(x  ,  y ) 

j=0  k  =  l  x  £  F..,  , 


P(z  ;>)=£  X  7-V  1  P(z;x)  +  (z-l)  p(0;x)  p(x.y) 


In  this  section  we  derive  the  additional  equation  that  is  shown  in  (13).  We  start  by 


a 


3 

s 


adding  all  the  equations  that  are  given  by  (9)  and  by  using  (8b)  we  obtain 


V  I  in  / 


P(z)=£  X  (V-I)z  “  |P(z  ;  x)  +  (z-1)  p(0  :  x)|  +  z  |P(z  ;  x)  +  p(0  ;  x)| 


v--0  x  e  Fv 


Bv  adding 


zP(z)-z  X  S  P(z  ;  x)  =  0 

v=0  x  e  Fv 


in  the  first  equation  and  rearranging  we  obtain 


P(z)  = 


where 


A(z)=£  £  [(v-l)z  '  |P(z  ;  x)  +  (z-1)  p(0  ;  x)|  +  z  |P  (z  ;  x)  +  p(0  ;  x)]  -  zP  (z  ;  x) 

v=0  x  £  Fv 

Since.  P  ( 1 )  is  the  average  number  of  packets  in  the  system,  which  is  finite  if  (5)  holds, 
and  since  1-z  =  0  for  z=  1 ,  we  compute  P  ( 1 )  by  applying  L'Hospital's  rule  to  (B 1 )  ;  thus 

dA(z);dz 

P(z)  |  ,  = -  L_,  =-dA(z)/dz  |  ,  (B2) 

d(l-z)/dz 

From  condition  ( B2)  and  by  using  (8b)  we  obtain  ( 13). 

To  calculate  the  steady  state  probability  of  having  no  packet  in  the  system  we 
proceed  as  before.  We  start  by  adding  the  equations  given  by  (6)  and  by  using  (8  )  we 
obtain 


P(z)=£  £  i  |P(z  ;  x)  +  iz-1 )  p(0;x)| 


v=0  x  £  Fv 


Bv  adding 


zP(z)  -  z  £  £  P(z;x)  =  0 


v=0  x  c  Fu 


in  the  previous  equation  and  rearranging  we  obtain 


P(z)  = 


where 


B(z)=£  X  (z  -z)[P(z;x)  +  (z-l)p(0;x) 
v=0  x  £  F„ 


Since  P(1 )  =  1  <  <»  and  1  -  z  =  0  for  z  =  1,  we  compute  P  (1 )  by  applying  L'Hospital’s 
rule  to  (B3);  thus 


1  =  P(z)  |  z= 


dB(z)/dz 

d(l-z)/dz 


=  -  dB(z)/dz 


From  condition  (B4)  and  by  using  (7b)  we  have 


p0=i-i  sv7c^)=i-z  i 

v=0  x  £  Fv  v=0  X  e  Fv  i=l 

The  previous  expression  after  some  manipulations  results  in  (14). 
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